Score-Following System for Orchestra Music Using Audio-Signal Amplitude

Personal Orchestra: Conducting Audio/Video Music Recordings

Personal Orchestra lets anybody conduct an electronic orchestra at a new level of realism: users interact not with a synthetic, but an original audio and video recording of a real orchestra—the Vienna Philharmonic. Nevertheless, they can interactively control not only volume and instrumentation, but also tempo of the orchestra, using natural conducting gestures. A gesture-tracking and -predicti...

Polyphonic Audio Matching for Score Following and Intelligent Audio Editors

Getting computers to understand and process audio recordings in terms of their musical content is a difficult challenge. We describe a method in which general, polyphonic audio recordings of music can be aligned to symbolic score information in standard MIDI files. Because of the difficulties of polyphonic transcription, we perform matching directly on acoustic features that we extract from MID...

Orchestra/Percussion Classification Algorithm for United Speech Audio Coding System

Signal-to-Score Music Transcription using Graphical Models

We present a transcription system that takes a music signal as input and returns its musical score. Two stages of processing are used. The first employs a fundamental frequency detector and an onset detector to transform input signals into a sequence of sound events. The onset detection is inherently noisy. This paper focuses on the second stage, going from sound events to a notated score. We u...

Audio-to-score alignment of piano music using RNN-based automatic music transcription

We propose a framework for audio-to-score alignment on piano performance that employs automatic music transcription (AMT) using neural networks. Even though the AMT result may contain some errors, the note prediction output can be regarded as a learned feature representation that is directly comparable to MIDI note or chroma representation. To this end, we employ two recurrent neural networks t...